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ABSTBACT 

Hhen the school or district is the unit of analysis 
in school effects research, the outcome of interest is mean 
achievement, and the variance explained by school or district level 
predictors is between schools or between districts* Khen the 
individual is the unit of analysis, the outcome of interest is 
individual achievement and the variance explained by school or 
district level predictors is between individuals. A technique called 
situational regression (SB) is described which provides a link 
between these levels of analysis* SB involves regressing a criterion 
variable measure at the individual level on one or more predictor 
variables measured at the group level* Predictors are measured 
characteristics of the groups e«g., schools, to which individuals 
belong and may include socioeconomic status (SES) , percent detily 
attendance at the school (ATTEN) and the number of resource teachers 
assigned to the school (BEST)* Data illustrating the SB technigue 
were taken from composite student achievement scores of all grade 5 
students in one district and regressed on SES, ATTEN, and BEST* These 
three school level variables together accounted for almost 17 percent 
of the individual variance in achievement scores and represented 
nearly 70 percent of the between school variation in achievement. 
(BL) 
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INTRODUCTION 



The tmit of analysis in school effects research is 
sometimes the individual and sometimes the school or school 
district (Spady, 1973; Bryant, Glazer, Hanssn, and Kirsch, 
1974; Centra and Potter, 1980). When the school or district 
is the unit of analysis the outcome of interest is mean 
achievement and the variance explained by school or district 
level predictors is between schools or becween districts. 
When the individual is the unit of analysis the outcome of 
interest is individual achievement and the variance explained 
by school or district level predictors is between individuals. 
Translation between these levels has been difficult. The 
technique described in this paper provides a link between 
these levels of analysis. 

The technique, which I will call "situational regres- 
sion" for brevity, was developed by Demaree, James, and 
Hater (1979; also James, Demaree, and Hater, 1980) in the 
context of organizational research where questions often 
arise about the relationship of some characteristic of work- 
groups to individual productivity, absenteeism or some other 
criterion. In general, situational regression involves 
regressing a criterion variable measure at the individual 
level on one or more predictor variables measured at the 
group level. The oredictors are usually measured character- 
istics of the groups to which individuals belong, not within 



group aggregates of individxial characteristics » though these 
are not precluded. 

SITUATIONAL REGRESSION 
Suppose we have access to individual student achieve- 
ment data for all elementary schools in a particular district 
and are interested in the relationship between the composite 
achievement scores of fifth grade students, and the SES of 
the school attendance areas, X. The SES measure is not aggre- 
gated over students, but represents the avers-^e SES of the 
census tracts overlapping each attendance area. In this case 
SES is considered a measiired school level variable that 
displays no natxiral within school variation. Many of the 
predictors used in school effects research are similar in 
this regard, e.g. school size, per pupil expenditure, staff 
size, etc. 

Rather than aggregate the achievement data to the 
level of the predictor, in situational regression each student 
is assigned the SES score characteristic of his or her school. 
Tb.e regression is then performed in the individual sample. 
Since this example involves only one predictor and one 
criterion, the proportion of achievement variance accounted 
for by school SES is r^^ over all students in the individual 
level sample. This r^^ represents the degree of linear rela- 
tionship between individual achievement and school SES. 

Demaree, et al. , have shown that: 
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r « r— ^ 
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When X is a school level predictor the variation it accounts 

for in Y in the individual sample is some portion of the 

total variation in Y accounted for by group membership. This 

portion is eqtial to the variance in the weighted group Y means 

accounted for by the school level predictor. 

From equation (1) it is clear that a group level 

variable cannot account for a greater proportion of the 

individual level criterion variance than is associated with 

differences between groups. The maximimi proportion of vari- 

2 2 

ance that can be accounted for by is eta^ and will occur 

when r|j - 1. This means that r|j is the proportion of total 

2 2 
between group variation (eta^) accounted for by r^^* This 

can be seen by reexpressing equation 2: 

eta^ 

These relationships may be extended to cases involv- 
ing more than one school level predictor variable, i.e.: 

4x ■ 4x «"y' 

where X represents a set of p school level predictor variables. 
To determine the extent to which the variation in Y accounted 
for by X is associated with between group differences we re- 
express the equation as : 

^X • 
eca^ 
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Given that the relationships between the Y and the 
X are linear, l-^fj represents the proportion of between 
group variance in Y not accoijnted for by X. For example, 
Bryant. Glazer, Hansen and Kirsch (1974) present data taken 
from the Coleman report indicating that 10.32 percent 
of the variation in verbal achievement among northern white 
sixth grade students was accoimted for by schools. The total 
achievement variance account e . for by school level indices 
of student body characteristics, facilities and ctirriculxjm. 
and teacher body characteristics was 7.35 percent. What 
proportion of the variation between schools was accounted for 
by these three sets of variables? From eqTiation 3 we have 

4v - • .0735 - .7122. 

2 .1032 
eca^ 

Approximately 71 percent of the between school 
variance was accounted for by the variables comprising the 
three sets of school level indices. About 29 percent of the 
between school achievement variation for white northern sixth 
grade students was not accounted for by the relationship of 
individual achievement to the three school level indices. 

The link that situational regression provides between 
the indi'/idual level and the group level of analysis is the 
relationship between R^^^ and r|j. Many authors have noted 
that regression analyses using group means on Y amount to 
between group analyses (e.g. Bryant, et al. , 1974; Brookover, 
Beady, Flood, Schweitzer, and Wisenbaker, 1979). Demaree, 
et al. , have demonstraced that in research with intact groups 
the regression of individual outcomes on group characteristics 



is also a becveen group analysis. The maximum variation any 
group level variable can account for in an individual level 
criterion variable ,is limited by the total criterion variance 
accounted for by group membership, and by the degree of linear 
relationship of the group criterion means to the group level 
predictors . 

LIMITATIONS 

Ta part, the usefulness of the situational regression 

2 

technique hii^ges on the usefulness of eta^ as an indicator of 
the degree of be "^ween group variation. Glass and Hakstian 
(1969) correctly pointed out that the interpretation of 
measures like eta^ in fixed effects ANOVA designs is proble- 
matic. The problems arise from the arbitrary representation 
of treatment levels in such designs. The use of eta^ in 
school effects research employing situational regression is 
subject to such criticism to the extent that schools (repre- 
senting levels in a one-way design) are arbitrarily selected. 
If, however, schools are selected at random or if, as is the 
case in the example to follow, all schools of interest are 
represented in the analysis, the use of eta^ as a measure of 
the total between school criterion variation is appropriate. 

^when group Ns, the n^. differ widely the larger groups 

2 

will be weighted more in determining R^^. This may cause 
problems if the are not representative of group membership 
in the overall population to which generalization is intended. 

It is important that the number of group level pre- 
dictors be smaller than the number of groups. In the limiting 
case, if there are k groups and p * k - 1 group level 



predictors, the set of predictors will serve only to Identify 

group xaembershlp . In such cases the group level variables 

provide little information about the sources of between group 

differences. Demaree, et al. suggest the rule of thumb that 

r|^> .50 and k > .5 p hold before attaching conceptual signif- 
2 

icance to Ryx' 

REAL DATA EXAMPL.^ 

The data for this illustration of the situational 
regression technique were taken from the achievement test 
records of fifth grade students at all elementary schools in 
a single district. The records were arranged by school, but 
randomly within schools. A sample was drawn by selecting 
every other record. The total N was 2277 students., the 
number of schools was 54, and the within school ranged 
from 20 to 100. The sampling procedure insxared that the 
would approximate their proportions in the population of the 
district's fifth graders. 

The composite student achievement scores were regres- 
sed in stepwise fashion on the following school level variables 
after assigning each student his or her school's score on the 
variable: 

1. SES, the average SES of the 1970 census tracts 
overlapping the school's attendance area. 

2. TRANS, the rate of transiency at the school 
defined as the number of entrants + number 
of leavers divided by total enrollment. 

3. ATTEN, the percent attendance at the school 
defined as the ratio of average daily atten- 
dance to average daily membership, taken as 
a percent. 



4. PTR5, the pupil*teacher ratio in grade five, 

5. REST» the nxsnber of resource teachers 
assigned to the school. 

The results of the stepwise procedure are given in 

Table 1. The three variables selected for inclusion in the 

equation on the basis of partial F tests were SES, REST, and 

ATTEN. It should be noted that the partial F test for incre- 

2 

oients to R are the saxne whether the predictor variables are 
group level or individxial level. 

The interpretation of R^^, r|j, and 1 - r|^ is rela- 
tively straightforward. First of all we note that eta^ - .237, 
that is about 24 percent of the variance in achievement is re- 
lated to differences between schools. Of the school level 
variables included in the analysis the socio-econimic status of 
the attendance area (SES) , the number of resource teachers 
assigned the school (REST) , and the percent attendance at the 
school (ATTEN) together accoxanted for almost 17 percent of the 
individual variance in achievement scores • This represents near- 
ly 70 percent of the between school variation in achievement, 
leaving 30 percent unaccoimted. According to Demaree, et al. 
chis might indicate a need to include other school level varibles 
or to include school means on individual difference variables. 

DISCUSSION 

There have been many criticisms of school effects 
research, sone of which were summarized by Centra and Potter 

(1980): 

Between- school studies have not been success- 
ful in identifying school (or district) char- 
acteristics that are highly related to how 
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much students learn. Although schools appar* 
ently do make some difference, most of the 
variability in student achievement is related 
to student social class or to within-school 
factors, (p. 281) 

The authors point out that within-school factors offer 
a more promising line of research, listing such things as 
teacher characteristics, administrative organization of the 
school, instructional grouping, etc. Whether the school 
district, school building, or classroom is the level of 
analysis, however, the degree of relationship of any charac- 
teristic of the group to an individual level criterion is 
limited by the degree to which variation in the criterion is 
related to group membership. 

The situational regression technique provides a means 
to move between levels of analysis. For example, a school 
administrator told that mean achievement in the district's 
schools correlates . 75 with building level ADA might start an 
expensive TV ad campaign to promote attendance. If, however, 
this person knows that the total variation in achievement 
accounted for by schools is .10, he or she might reconsider 
spending a lot of money on something that accounts for only 
five percent of the achievement variance between students. 

In summary, sitxiational regression provides a means 
fot assessing the relationship between an individual level 
criterion variable and one or more group level predictor 
variables. The individual criterion variance accotmted for 
by the group level predictors was shown to be the product of 
the weighted group mean criterion variance accounted for by 
the predictors, times the total criterion variance accounted 
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for between groups. The maximum amount of criterion variance 
in the individual sample that can be accoxmted for by a group 
level predictor is limited by the degree of between group 
variation in the criterion. Situational regression is most 
useful in cases where the predictors are measured character- 
istics of groups, having no individual level counterpart. 
In such cases soxirces of between group variation in the 
criterion variable may be explored in terms of the group level 
predictors that accoxint for most variation in the sample of 
individuals. 
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TABLE 1 



VARIABLE CUMULATIVE CUMULATIVE CUMULATIVE 

CHANGE F r|jj ^"^YX 



STEP 


ENTERED 




1 


SES 


.141 


2 


REST 


.156 


3 


ATTEN 


.165 



375.25* .599 .401 

.014 38.58* .659 .341 

.009 24.14* .697 .303 



etEy = .237 
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